Papers with JBDistill pipeline
Jailbreak Distillation: Renewable Safety Benchmarking (2025.findings-emnlp)
Copied to clipboard
Jingyu Zhang, Ahmed Elgohary, Xiawei Wang, A S M Iftekhar, Ahmed Magooda, Benjamin Van Durme, Daniel Khashabi, Kyle Jackson
| Challenge: | a new framework for safety benchmarking is being developed for large language models . the framework "distills" jailbreak attacks into high-quality and easily-updatable safety benchmarks . |
| Approach: | They propose a framework that "distills" jailbreak attacks into high-quality safety benchmarks. |
| Outcome: | The proposed framework "distills" jailbreak attacks into high-quality safety benchmarks . it requires minimal human effort to rerun the pipeline and produce updated benchmarks. |